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© File system with read/write and read only storage. 

(g) A file system (101) which has component file 
systems including a primary file system (111) 
which is read/write and a number of dump file 
systems (109) which are read only. Each dump 
file system is created from the primary file 
system by means of a dump operation and 
conserves the state of the primary file system at 
the time the dump operation was performed. 
Component file systems share read only storage 
elements (519) with older component file sys- 
tems. The file system is Implemented on a 
system including a file server (503), a magnetic 
disk mass storage device (507), and an optical 
write once-read many (WORM) disk (511). The 
magnetic disk mass storage device contains the 
read/write storage elements of the primary file 
system and encached read only storage ele- 
ments from the WORM disk. Space (516) fs 
reserved on the unwritten portion (515) of the 
WORM disk for the read-write storage elements 
of the primary file system. Techniques for per- 
forming file operations including opening, read- 
ing, writing , creating, and deleting files are 
disclosed, as well as techniques for performing 
the operations of dumping and restoring the 
primary file system. 
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Background of the Invention 

1. Field of the Invention 

The present invention is related to data storage in 
digital computers generally and more specifically to 
data storage using write once-read many (WORM) 
devices. 

2. Description of the Prior Aft 

Various automated backup techniques have 
been developed for computer systems. Recently, 
automated backup systems have emerged in which 
the copies of the backed up files are stored on write 
once-read many or WORM devices. As the name 
implies, data can be written once to a WORM device 
and the data stored thereon can be read many times. 
Modem WORM devices are optical devices which pro- 
vide random access to enormous quantities of date. 
Adescription of an optical disk WORM device may be 

found In , , _ 

Gait, Jason. "The Optical File Cabinet A Ran- 
dom-Access File System for Write-once Optical 
Disks". IEEE Computer, June, 1988, pp. 11-22 

An example of a file backup system employing an 
optical disk can be found In 

Hume, Andrew. The File Motel - An Incremental 
Backup System for UNIX" 1 988 Summer Usenlx Con- 
ference Proceedings, June 20-24, 1988, pp. 61 -72 

A problem which the above file backup system 
shares with many others Is that the backup copies of 
the files are not as accessible to users of a computer 
system as the files presently on the system. In some 
cases, the backup copies must be physically retrieved 
from an archive and loaded onto the computer sys- 
tem; in others, like the system described in the above 
publication, the files are physically available but must 
be specifically mounted on the file system before they 
are accessible. Further, special tools are often 
required to deal with the backup flies. 

Of course, if a file system is stored on media 
which cannot be erased, then the need for backups to 
protect against human mistakes or malice or equip- 
ment failures is eliminated. The art has thus 
developed file systems in which all of the data is 
stored on an optical WORM system. One such file 
system is described in the Gait article cited above. 
While such file systems are essentially indestructible, 
they are not without their problems. First, since the 
entire file system is stored on optical disk, many disk 
blocks are wasted on the storage of transient files, i.e., 
files which are created and deleted in the course .of 
execution of a program. Second, optical WORM 
devices are still substantially slower than magnetic 
disk devices, and file system performance suffers 
accordingly. While the speed problem can be 
alleviated by encachlng data which has been read 



from the optical WORM device so that there is no need 
to retrieve it from the WORM device for a following 
read, encachement cannot solve the problem of was- 
ted disk blocks. Further, though Gaifs WORM file sys- 

5 tern contains substantially all of the date that was ever 
in the file system, It includes no provision for making 
backups attlmes thatare significant to the usersof the 
system, and therefore does not provide a way of 
reconstituting a file system exactly as it was at such 

■to a significant time. 

What is needed, and what Is provided by the 
invention of claim 1. is a file system in which the user 
can select significant times to make backups and in 
which the backups made at these times are as avall- 

15 able to the user as any other files. 

Brief Description of the Drawing 

FIG. 1 Is an overview of the file system of the 

20 Invention; 

FIG. 2 Is a diagram of a component file system of 

the invention; 

FIG. 3 is a diagram of an operation which alters 
a primary file system in the file system of the pre- 

25 sent invention; 

FIGS. 4A and 4B are diagrams of a dump oper- 
ation In the file system of the present Invention; 
FIG. 5 Is an overview of a preferred implemen- 
tation of the present Invention; and 

30 FIG. 6 Is an overview of a preferred implemen- 

tation of the subdivision of mass storage device 
507. 

Reference numbers In the figures have two parts: 
the two right-most digits are numbers within a draw- 
as Ing; the left digit is the number of the drawing In which 
the Item indicated by the reference number first 
appears. Thus, the Item identified by the reference 
number 117 first appears in FIG. 1. 

40 Detailed Description 

The following Detailed Description of a preferred 
embodiment of the Invention begins with a discussion 
of the logical structure of the file system of the inven- 
45 tion, continues with a discussion of the operation of 
the file system of the Invention, and concludes with a 
discussion of an Implementation of the file system 
which employs an optical write once-read many opti- 
cal disk device and a magnetic disk device. 

Logical structure of the File Sys tem: FIGS. 1 
and 2 

This discussion of the logical structure of the file 
system first provides an overview of the entire file sys- 
tem of thB invention and then provides an overview of 
a component file system in the invention. 
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Overview of the File System; FIG. 1 

FfG. 1 is a conceptual overview of file system 101 
of the Invention. All information contained in file sys- 
tem 101 is stored In storage elements (SE) 105. Each 5 
storage element 105 has a storage element address 
(SEA) 107 and is randomly accessible by storage ele- 
ment address 107. SE 1 05 may be implemented as a 
block on a randomly accessible device such as a 
magnetic or optical disk drive or a memory. The total w 
number of possible storage element addresses 107, 
ranging from storage element address 1 07(0) through 
storage element address 107(max) makes up file 
address space (FAS) 103, The size of file address 
space 103 is, in principle, limited only by the size of is 
storage element addresses 107; however in some 
embodiments, its size may be determined by the size 
of the physical devices upon which storage elements 
105 are stored. 

Each storage element 1 05 belongs to one of three 20 
address spaces: read only address space 117, 
read/write address space 115, or unused address 
space 113. Storage elements 105 belonging to read- 
only address space 1 17 are inalterable components 
of file system 101 ; they may be read but neither writ- 26 
ten nor removed from file system 101. Storage ele- 
ments 1 05 belonging to read-write address space 115 
are alterable components of file system 1 01 ; they may 
be added to file system 1 01 , written to, read from, and 
removed from file system 101 . Storage element 105 30 
belonging to unused address space 113, finally, are 
neither part of file system 101 nor presently available 
to be added to ft. 

At the beginning of operation of file system 101, 
all storage elements 105 belong to unused address 35 
space 113; when a storage element 1 05 is req uired for 
file system 101, file system 101 moves the storage 
element from unused add ress s pace 1 1 3 to read/write 
address space 115; when a storage element 105 has 
become an inalterable component of file system 101 , 40 
file system 101 moves the storage element from 
read/write address space 115 to read-only address 
space 117. Once a storage efement 1 05 is in read only 
address space 117, it remains there. Consequently, 
as file system 101 operates, the number of storage 45 
elements 105 In unused address space 113 dec- 
reases and the number In read only address space 
117 Increases. When there are no more storage ele- 
ments 105 in unused address space 113, the user 
must copy the files he needs from file system 1 01 onto so 
another fife system. File address space 103 can, how- 
ever, be made so large that it is for practical purposes 
inexhaustible. 

For the sake of simplicity, FIG. 1 presents the 
address spaces as though they were separated by 55 
clear boundaries In file address space 103. That is 
true only for unused address space 113. A storage 
element address HWM 108(c) marks the "high water 



mark" in file address space 103, i.e., the address of 
the first storage element which belongs to neither 
read/write address space 115 nor read only address 
space 1 1 7. All storage elements having addresses of 
HWM 108(c) or greater belong to unused address 
space 113. However, any storage element 105 having 
an address less than HWM 108(c) may belong either 
to read/write address space 1 15 or read only address 
space 117. 

File address space 103 contains two kinds of 
component file systems: primary file system 111 and 
some number of dump file systems 109. Primary file 
system 111 behaves like a standard file system. 
Accordingly, all of the usual file operations may be 
performed on files in primary file system 111. Existing 
files may be read from, written to, and deleted; new 
files may be created. Flies in dump file systems 109, 
on the other hand, may only be read. As is apparent 
from these properties, primary file system 111 may 
have storage elements 105 belonging to read/write 
address space 115 or read only address space 117, 
while all storage elements 105 of a dump file system 
109 belong to read only address space 117. The line 
which appears In FIG. 1 at the top of each dump file 
system 109 represents the value of HWM 108(c) at 
the time the dump file system 109 was created; the 
line is thus labeled with the number of dump file sys- 
tem 109. A number of dump file systems 109 may 
have the same value for HWM 108. Storage elements 
105 belonging to a given component file system may 
be located anywhere in file address space 103 below 
HWM 108 for the file system, and a storage element 
105 may be shared by more than one component file 
system. 

A dump file system 109 Is created by performing 
a dump operation on primary system 111. The dump 
operation has the logical effect of adding those stor- 
age elements 105 in read/write address space 115 
which are part of primary file system 111 at the time 
of the dump operation to read only address space 
117. The dump operation in file system 101 is atomic, 
i.e. r no changes can be made in the files of primary 
system 111 during the dump operation. The dump 
operation accordingly conserves the state of primary 
file system 111 at the rime the dump operation was 
performed. As a consequence of the manner in which 
the dump operation is performed, the dump file sys- 
tems 109 are ordered in read only address space 117 
by the time at which the dump operation which 
created the dump file system 1 09 was performed, with 
the dump file system 109 resulting from the earliest 
dump operation having the lowest HWM 108 In read 
only address space 1 17 and the dump file system 109 
resulting from the most recent dump operation having 
the highest HWM 108. The dump file systems 109 
thus represent an ordered set of "snapshots" of past 
states of primary system 111. 

Each component file system Is organized as a 



3 



5 



BP 0 466 389 A2 



6 



tree, i.e., the storage elements 105 for all of the files 
in the component tile system are accessible from a 
root 121 In the component file system. As previously 
indicated, storage elements 105 in primary file system 
111 may belong to either read/write address space 
1 15 or read only address space 1 17. The storage ele- 
ments 105 belonging to read/write address space 115 
are those which have new contents, i.e., those which 
contain parts of primary file system 111 which have 
been altered since the last dump operation. The stor- 
age elements 105 belonging to read only address 
space 117 are those which have old contents, i.e., 
those storage elements 105 in which portions of the 
file system are stored which have not been altered 
since the last dump operation. 

As is apparent from the foregoing and the manner 
in which a dump file system 109 is created, the stor- 
age elements 105 of primary file system 111 which 
had new contents when dump file system 109 was 
created belong to the addition to read only address 
space 1 17 which was made when the dump operation 
was performed and the storage elements 105 of prim- 
ary file system 111 which had old contents when 
dump file system 109 was created belong to the read 
only address space 117 which existed prior to the 
dump operation and are shared with earlier compo- 
nent file systems. This fact is Indicated in FIG. 1 by 
shared element pointers (SEP) 129 in each compo- 
nent file system. The storage elements 105 pointed to 
by these pointers are shared with at least one other 
older component file system. In the case of the prim- 
ary file system 111, such storage elements 105 are 
ones whose contents have not been altered since the 
last dump operation; in the case of a given dump file 
system 109, the shared element pointers 129 point to 
storage elements 1 05 which were not altered between 
the dump operation which created the preceding 
dump file system 109 and the dump operation which 
created the given dump file system 109. As is farther 
apparent, a given storage element 105 in read only 
address space 117 Is part of every component file 
system from the dump file system 109 resulting from 
the first dump operation after the given storage ele- 
ment 105 was incorporated into primary system 111 
to the dump file system 109 (if any) produced by the 
dump operation Immediately preceding the time at 
which the contents of the given storage element 105 
were modified in the course of file operations on prim- 
ary file system 111. 

Each root 121 is itself accessible from location 
information block 119 in each component file system 
by means of root pointer (RP) 127, which points to 
storage element 105 which contains root 121. 
Additionally, each location information block 119 con- 
tains dump pointers (DPS) 125 to roots 121 in each 
component file system which precedes the compo- 
nent file system to which location information block 
119 belongs and a next pointer (NP) 123 to the loca- 



tion information block 119 in the component file sys- 
tem which succeeds the component file system to 
which location information block 119 belongs. Loca- 
tion information block 119 for the first dump system 
5 109(1), finally, is at a predetermined address in fife 
address space 103. Every file in fife system 101 may 
thus be located either directly from location infor- 
mation block 1 19(c) In primary file system 1 1 1 or indi- 
rectly from location information block 119(1)- The 
10 chain of location information blocks beginning with 
location information block 119(1) is used to recon- 
struct location information block 119(c) in case of a 
failure of the physical device upon which read/write 
address space 115 Is implemented. Location infor- 
ms mation block 1 1 9(c) serves in effect as a root for al I of 
the files In file system 1 01, and it is consquentiy poss- 
ible for a user of file system 101 to locate and read a 
file in a dump file system 109 in exactly the same way 
as the user would locate and read a file in primary file 
20 system 111. For example, from the user's point of 
view, comparing a version of a file in primary file sys- 
tem 111 with a version of the file in a dump file system 
1 09 is no different from comparing two versions of the 
file in different directories of primary file system 111. 

25 

Detailed Structure of a Component File System; 
FIG. 2 

FIG. 2 is a diagram of the structure of a compo- 
se) nent file system in file system 101. All of the infor- 
mation which is contained in the files and which is 
needed to organ ize the flies into a file system is stored 
in storage elements 105, All of the component file sys- 
tems have similar structures; however, in dump file 
35 systems 109, all of the storage elements 1 05 in the file 
system belong to read only address space 117, while 
primary file system 111 has some storage elements 
105 which belong to read only address space 117 and 
others which belong to read/write address space 115. 
40 The files in the component file systems are hierar- 

chical. Each file belongs to a directory and a directory 
may contain files or other directories. The hierarchy 
has the form of a tree with a single root node. The 
directories are internal nodes of the tree and the files 
45 are the leaf nodes. In a preferred embodiment, there 
is a single path through the tree from the root to each 
leaf node, i.e., no file or directory belongs to more than 
one directory. 

As shown in FIG. 2, component file system 201 
so has two main parts: location information 119 and file 
tree 202. Beginning with file tree 202, tree 202 has two 
kinds of elements: directory blocks (DB) 219, which 
represent directories, and data blocks (DATA) 225, 
which contain the data for a file. Directory blocks 219 
55 contain two kinds of entries: file entries (FE) 221, 
which represent files belonging to the directory, and 
directory entries (DE) 223, which represent direct 
tories belonging to the directory. There is one file 
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entry 221 and one directory entry 223 for each file and 
directory belonging to the directory. A fife entry 221 
contains data pointers (DATA PTRS) 229 to the data 
blocks 225 which contain the file's data; a directory 
entry 223 contains a directory pointer (DIR PTR) 231 
to directory block 21 9 for the directory represented by 
directory entry 223. As will be explained in more detaf f 
below, data blocks 225 and directory blocks 21 9 may 
be shared with other older component file systems; 
when that Is the case, the data pointers 229 to those 
data blocks and the directory pointers 231 to those 
directories are shared element pointers 129. 

Location information 119 has three components 
in a preferred embodiment: superblock (SB) 203, 
dump list (DL) 211, and free list (FRL) 207. 
Superblock 203 contains pointers by which the other 
parts of a component file system can be located, is 
pointed to by next pointer 123 belonging to the pre- 
ceding componentfile system, and Itself contains next 
pointer 123 to superblock 203 for the following com- 
ponent file system. In the case of superblock 203 for 
primary file system 111, the superblock contains 
HWM 108(c). These contents are arranged in 
superblock 203 as follows: HWM 108 contains HWM 
108(c) In primary file system 111 and the value of 
HWM 108(c) at the time the dump operation was per- 
formed in dump file systems 109. NP 123 contains 
next pointer 123 in dump file systems 109; RP 127 is 
the pointer to root 121 for the component file system; 
DLP 27 is a pointer to dump list 211; FRLP 205 is a 
pointer to free list 207. 

Dump Jist 21 1 contains a list of all of the dump file 
systems 109 which precede the component file sys- 
tem to which dump list 211 belongs. Each entry (DLE) 
213 In dump fist 21 1 has two parts: dump identifier 215 
and dump pointer 2 17. Dump identifier 21 5 is a unique 
identifier which identifies the dump file system 109 
represented by dump list entry 213; In a preferred 
embodiment, dump identifier 215 specifies the time 
and date at which the dump operation which created 
dump file system 109 was carried out. Dump pointer 
217 is a pointer to root 121 for the dump file system 
109 represented by dump list entry 213. Taken 
together, the dump pointers in dump list 211 thus 
make up dump pointers (DPS) 125. 

Free list 207, finally, is a list of addresses 107 of 
storage elements 105 which are no longer part of 
unused address space 1 13 but are not presently part 
of primary file system 1 1 1. For example, If a new file 
is created In primary file system 111 after the last 
dump operation and then deleted before the next 
dump operation, the addresses 107 of the storage ele- 
ments 105 from the deleted file are placed on free Jist 
207. Free list 207 is an important advantage of file 
system 101, since it permits the set of storage ele- 
ments 1 05 belonging to read/write address space 115 
to fluctuate between dump operations without a cor- 
responding fluctuation of unused address space 113. 



Though free list 207 Is part of every component 
file system, it has significance only in primary file sys- 
tem 111, where it is the source of storage elements 
105 to be added to primary file system 111, and the 
5 most recent dump file system 1 09, where it Is used to 
reconstitute primary fife system 111'a free list 207 
after a destruction of primary file system 111. When 
free 1 1st 207 in primary file system 1 1 1 becomes empty 
as a result of incorporation of free storage element 
10 105 into primary file system 111, file system 101 
obtains a new storage element 105 from unused 
address space 113 by adding the current value of 
HWM 108(c) to free list 207 and incrementing HWM 
1 08 in superblock 203. 
15 As previously mentioned, the storage element 

105 making up primary file system 111 belong to 
either read-write address space 115 or read only 
address space 117. In more detail, the storage ele- 
ments 105 containing the components of location 
20 information 119 and root 121 always belong to 
read/write address space 1 15, as do the storage ele- 
ments 105 on free list 207. The parts of tree 202 are 
in read/write address space 1 1 5 as follows: Any direc- 
tory block 219 which is part of a path to a file which is 
25 presently open for an operation wh ich alters the file is 
contained In a storage element 105 in read/write 
address space 115; Any data block 225 which has 
been written to since the last dump operation is con- 
tained in a storage element 105 In read/write address 
30 space 115. 

The technique by which storage elements 105 
containing new contents replace those with shared 
contents will be explained in detail below. 

35 Performing Operations on Component Fife 
Systems: FIG. 3 

Operations on fife systems can be divided into 
two classes: those which alter the file system and 
40 those which do not Operations of the second class, 
termed hereinafter read operations, can be performed 
in the usual manner on any component file system of 
file system 101. Operations of the first class, termed 
hereinafter write operations, may be performed only 
45 on files and directories in primary file system 111. FIG. 
3 shows how two of the write operations, file open and 
file write, are performed in a simple example primary 
file system 111 which contains exactly one file. Each 
block In FIG. 3 contains a number In parenthesis indr- 
50 eating the type of component represented by the 
block and an indication of the address space to which 
the storage element 105 containing the component 
belongs. Thus, root 121 is a directory block 219 and 
belongs to read/write address space 115. 
55 The portion of FIG. 3 labeled 301 shows the 

example primary file system 1 1 1 at a time after the iast 
dump operation but before the single file has been 
opened. Only root 121 belongs to read/write address 
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space 115; the remaining components, including 
directory 303 to which the file belongs and the data 
blocks 305 and 307 for the file belong to read only 
address space 117, i.e., directory 303 and data blocks 
305 and 307 are shared at least with dump file system $ 
109 made by the fast dump operation, as indicated by 
pointer 302 from root 121 for the immediately preced- 
ing dump file system 109. 

The next portion, labeled 309, shows the example 
primary file system 1 1 1 at a time after the single file 10 
has been opened for writing but before any file write 
operation has occurred. Because the file has been 
opened, it must have a directory block 219 In 
read/write address space 115. This directory block 
219, which has the number 31 1 in the FIG., is made is 
by taking a storage element 105 from free list 207, 
copying the contents of directory block 303 Into direc- 
tory blo* 31 1, and changing pointer 231 In root 121 
to point to directory block 311 instead of directory 
block 303. Data blocks 305 and 307 are now pointed 20 
to by both directory block 303 and directory block 31 1 , 
as indicated by 312 and 304, representing data poin- 
ters 229 pointing to the data blocks. 

The final portion, labeled 31 3, shows the example 
primary file system 111 after a file write operation 25 
which has altered data originally contained in data 
block 307. The altered data requires a new data block, 
block 315, which belongs to the read/write address 
space 115. Block 31 5 is taken from free list 207 as bef- 
ore and the data pointers 229 In directory block 311 30 
are reset so that block 315 takes the place of block 
307. Then the altered data is written to block 315. At 
the end of the operation, file entry 221 for the file in 
directory 311 points to blocks 305 and 315, as indi- 
cated by pointer 31 7 t while file entry 221 for the file in 35 
directory 303 still points to blocks 305 and 307 as indi- 
cated by pointer 304. Thus, the original file is retained 
in dump file system 1 09 and the altered file In primary 
system 111. 

Other standard file operations are performed 40 
analogously. For example, when a file is created, a 
new file entry 221 for the file is made in a directory 
block 219; if the directory block 219 already belongs 
to read/write address space 115, the new file entry is 
simply added to the directory block 219; otherwise a 45 
new directory block 219 is made as described above 
for the open operation and the new file entry 221 is 
added to the new directory block. In the case of a file 
delete operation, only those data blocks of the file to 
be deleted which belong to read/write address space so 
115 can be deleted; this is done by returning the 
addresses of storage elements 105 containing the 
deleted data blocks 225 to free list 207. At the same 
time, the file entry 221 in the directory block 219 for 
the directory to which the file belongs is also deleted. 55 
If all of the file entries 221 and directory entries 223 
in a directory block 219 are deleted, that block's stor- 
age element 105, too, is returned to free list 207. As 



shown by the delete example, a particular advantage 
of file system 101 is that changes in primary file sys- 
tem 111 which affect primary file system 111 for a 
period which Is less than the period between dump 
operations take place In read/write address space 
1 15 and do not add storage elements 105 to read only 
address space 117. 

The Dump Operation: FIGS. 4A and 4B 

In broad terms, the dump operation creates a 
dump file system 109 by moving storage elements 
105 in primary file system 111 which belong to 
read/ write address space 115 from read/write 
address space 115 to read only address space 117 
and reestablishing the parts of primary file system 111 
which must be presently alterable in read/write 
address space 115. In a preferred embodiment, the 
algorithm for performing the dump operation is the fol- 
lowing: Set next pointer 123 in superblock 203 for 
primary file system 1 11 to HWM 108; Add all storage 
elements 105 for primary file system 111 which 
belong to read/write address space 1 1 5 and which are 
not on free list 207 to read only address space 117; 
Reestablish primary file system 111 in read/write 
address space 1 15 by doing the following: Copy the 
contents of superblock 203 to storage element 105 
having HWM 108 as its storage element address 107 
to make a new superblock 203 for the primary file sys- 
tem 111 and increment HWM 108 In the new 
superblock 203 to point to the next storage element 
105; Taking storage elements 105 from free list 207, 
copy location information 119 and root 1 21 to the stor- 
age elements 105; Update the pointers in the new 
superblock 203 to point to the location Information 119 
and root 121 In the storage elements 105 taken from 
free list 207; Add an entry for the new dump file sys- 
tem 1 09 to dump list 21 1 ; and For every file in primary 
file system 111 which Is open at the time of the dump 
operation, walk tree 202 from root 121 in new 
read/write address spam 115 to directory block 219 
which contains file entry 22 1 for the file; for each direc- 
tory block 219 encountered in the walk which Is not yet 
in new read/write address space 115, copy the direc- 
tory block 219 to a storage element 105 taken from 
free list 207 and alter directory entry 223 and any 
copies of information from directory entry 223 in the 
computer system to which file system 101 belongs to 
point to the new copy. 

The algorithm is performed atomically, i.e., no 
changes to file system 101 other than those required 
for the algorithm are permitted during execution of the 
algorithm. 

In an alternative embodiment, the contents of 
superblock 203 may be copied to a new superblock 
203 taken from free list 207, next pointer 123 updated 
to point to the new superblock 203, and then all stor- 
age elements 105 in read/write address space 115 
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other than the new superblock 203 added to read only 
address space 117. 

FIGS. 4A and 4B show how the dump operation 
works in a primary file system 111 which contains 
exactly one directory in which there is exactly one 
dosed file. Again, each box in the file contains a refer- 
ence number indicating what kind of component of 
primary file system 111 the box represents and an 
indication of which of the address spaces 115 and 117 
the component belongs to. FIG. 4A shows primary file 
system 401 as it exists at the time of the dump: Com- 
ponents 401 , 403, and 405, making up location infor- 
mation 119, root 407 and directory block 409 all 
belong to read/write address space 115; the file has 
one data block 411 which has not been altered since 
the last dump operation, and consequently belongs to 
read only address space 1 1 7; the other data block 41 3 
has been altered, and so belongs to read/write 
address space 115. 

FIG. 4 B shows primary fife system 41 5 as it exists 
after completion of the dump; components 401-409 
and 413 have all been moved to read-only address 
space 117, copies 417-423 in read/write address 
space 1 15 have been made of components 401-407, 
pointers in the copies of location Information 119 have 
been set so that root pointer 127 points to new root 
423 and dump pointer 217 points to old root 407, and 
next pointer 123 in old super block 401 has been set 
to point to new superblock 417. If the ffle had been 
open, there would additionally have been a copy of 
directory block 409, and new root 423 would point to 
the copy. 

Replacing Primary System 111 With a Pump File 
System 10ft 

An advantage of file system 101 is that primary 
file system 111 may be easily replaced by any of the 
dump file systems 109. Replacement is done by per- 
forming the following steps, again atomfcaFfy: Except 
for those which contain location Information 119, 
return the addresses of all storage elements 105 in 
primary file system 111 which belong to read/write 
space 1 15 to free list 207; Using dump pointer 217 for 
the dump file system 1 09 which is replacing primary 
file system 111, locate root 121 for the dump file sys- 
tem 109 and copy root 121 into a storage element 105 
from free list 207; Replace root pointer 127 in 
superblock (SB) 203 with a pointer to the copy of root 
121 for the dump file system 109. 

If a failure in the computer system to which the file 
system belongs has resulted in the loss of location 
information 119, the location information 119 may be 
copied from location information 119 In the most 
recent dump file 1 09. In this case, if the dump file sys- 
tem 109 which is replacing primary file system 1 11 is 
the most recent dump file system 109, then the sec- 
ond step above is omitted. 



Implementation of File System 101 on a 
Read/write Mass Storage Device and a WORM 
Storage Device: FIGS. 5 and 6 

5 In a preferred embodiment, file system 101 is 

implemented using a read-write mass storage device 
and a WORM storage device. In the following, there 
will first be presented an overview of the Implemen- 
tation and the relationship of its components to file 
10 address space 1 03; then details of the organization of 
the read/write mass storage device will be presented, 
followed by details concerning the operation of the 
preferred embodiment 

16 Overview of the Implementation: FIG. 5 

FIG. 5 is a high-level block diagram of a preferred 
implementation of file system 101. Implementation 
501 has three main components: file server 503, ran- 
20 dom access read/write mass storage device 507, and 
random access write once-read many (WORM) 
device 511. File server 503 is a computer system 
which Is employed in a distributed system to perform 
file operations for other components of the distributed 
25 system. In the preferred implementation, file server 
503 is a VAX 760, manufactured by Digital Equipment 
Corporation. The file operations which it performs for 
other components are substantially the same as 
those defined for the well-known UNIX® operating 
so system. File server 503 controls operation of the other 
components of implementation 501. Mass storage 
device 507 in a preferred embodiment is 120 mega- 
bytes of storage on a magnetic disk drive. WORM 
device 511 is the WDD-2000, a 1.5 gigabyte write- 
35 once optical disk manufactured by Sony, Inc. 

The storage In both mass storage device 507 and 
WORM device 51 1 Is divided into blocks of the same 
size. These blocks make up the storage elements 1 05 
of the implementation. The blocks in mass storage 
40 device 507 appear in FIG, 6 as disk blocks (DB) 509 
and those in WORM device 511 appear as WORM 
blocks (WB) 519. As will be explained in more detail 
later, disk blocks 509 correspond to certain WORM 
blocks 519. Such correspondences are indicated by 
45 letter suffix. Thus, disk block 509(a) corresponds to 
WORM block 519(a). File server 503 may both read 
and write disk blocks 509 many times: it may read 
WORM blocks 519 many times, but write them only 
once. These facts are indicated in FIG. 5 by read/write 
so operations arrow 505 connecting file server 503 and 
mass storage device 507 and the separate write once 
operation arrow 513 and read operation arrow 515 
connecting file server 503 and WORM device 511. 
They are further indicated by the division of WORM 
55 device 511 into unwritten portion 515 containing 
WORM blocks 519 which have not yet been written 
and written portion 517, containing written WORM 
blocks 519. Since WORM device 511 is random 
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access, written and unwritten blocks may be physi- 
cally intermixed. 

Before a dump operation, the relationship be* 
tween disk blocks 509 and WORM blocks 519 and file 
address space 103 Is the following: Written WORM 5 
blocks 519 belong to read-only address space 1 1 7, as 
do corresponding disk blocks 509; such disk blocks 
509 contain copies of the contents of the correspond- 
ing WORM blocks 519; Disk blocks 509 which corre- 
spond to unwritten WORM blocks 519 belong to 10 
read/write address space 1 15, as do the correspond- 
ing unwritten WORM blocks 51 9, which are reserved 
to receive the contents of the corresponding disk 
blocks 509 after a dump operation is performed, as 
indicated by the label "dump space 516" in their por- is 
tion of WORM device 511; Unwritten WORM blocks 
519 which have no corresponding disk blocks 509 
belong to unused address space 113. 

As implied by the above, disk blocks 509 which 
correspond to written WORM blocks 519 and those 20 
which correspond to unwritten WORM blocks 519 
have fundamentally different functions in file system 
101- That is shown in FIG. 5 by the division of mass 
storage device 507 into two parts: read only cache 
506 and read/write store 506. Again, since mass stor- 2s 
age device 507 is a random-access device, disk 
blocks 509 belonging to either subdivision may be 
located anywhere in mass storage device 507. 

Disk blocks 509 corresponding to written WORM 
blocks 519 serve as a cache 506 of those blocks. 30 
Mass storage device 507 has a faster response time 
than WORM device 51 1 t and consequently, when file 
server 503 reads a written WORM bloc* 519 from 
WORM device 511, it places a copy of that WORM 
block 519 in a disk block 509 so that it is available 35 
there if it is needed again. As is generally the case 
with caches, cache 506 contains copies of only a rela- 
tively small number of the most recently read WORM 
blocks 519. While cache 506 substantially enhances 
performance, it is not necessary to an implementation 40 
of file system 101, 

Disk blocks 509 corresponding to unwritten 
WORM blocks 519, on the other hand, are the actual 
storage elements 105 for read/write address space 
115 and are therefore essential to operation of file 46 
system 101. There must be a disk block 509 in 
read/write store 506 for every storage element 105 
which is a part of primary file system 111. Since dump 
space 516 is reserved to receive the contents of 
read/write address space 115 when a dump operation so 
is performed, there must be a WORM block 519 in 
dump space 516 corresponding to every disk block 
509 in read/write store 508. Additionally, there must 
be a WORM block 519 in dump space 516 corre- 
sponding to every storage element 105 on free list 55 
207. The storage elements 105 on free list 207, how- 
ever* need not have corresponding disk blocks 509 
belonging to read/write store 506. Accordingly, when 



free list 207 becomes empty and a storage element 
1 05 must be added to read, /write address space 115, 
dump space 516 must be expanded by one unwritten 
WORM block 519. As indicated by the presence of 
HWM 1 08(c) at the end of dump space 51 6, that is 
done by incrementing HWM 108(c). 

For a time after completion of a dump operation, 
mass storage device 507 contains a third subdivision: 
dump store 51 0. Dump store 510 contains disk blocks 
509 which are storage elements 1 05 which have been 
added to read only address space 117 by the dump 
operation. A disk block 509 remains In dump store 510 
until its contents have been copied into the corre- 
sponding WORM block 51 9 in dump space 516. Upon 
being written, the WORM block 519 becomes part of 
read-only address space 117 and its corresponding 
disk block 509 becomes part of read-only cache 506. 

As will be explained in more detail later, the actual 
dump operation in a preferred Implementation simply 
marks disk blocks 509 which contain parts of primary 
file system 111 which are In read/write address space 
1 15 as belonging to dump store 510. As soon as this 
is done, normal file operations continue. These oper- 
ations treat components of primary file system 111 
which are stored in disk blocks 509 belonging to dump 
store 510 as part of read-only address space 117. 
While these operations are going on, a dump daemon 
which executes independently in file server 503 
copies the contents of the disk blocks 509 to the cor- 
responding WORM blocks 519 in dump space 516. 
Once a disk block 509 has been copied, it is marked 
as belonging to read-only cache 506. 

It should be pointed out at this point that file 
address space 103 may be larger than the address 
space of WORM device 511. To begin with, unused 
address space 113 may extend beyond the top 
address in WORM device 51 1. Further, as long as all 
storage elements 105 belonging to the component file 
systems being operated on by file system 101 are on 
WORM device 51 1 1 read-only address space 117 can 
extend below the lowest address in WORM device 
511. 

Implementation of the Subdivisions of Mass 
Storage Device 507: FIG. 6 

In a preferred implementation, correspondences 
between disk blocks 509 and WORM blocks 519 and 
division of mass storage device 507 into read only 
cache 506, read/write store 508, and dump store 510 
are established by means of a mass storage map 603, 
shown in FIG. 6. In the preferred implementation, 
mass storage map 603 is a data structure in virtual 
memory 61 1 of file server 503. Since mass storage 
map 603 Is used in every file operation performed by 
file system 101, it is generally present in the main 
memory of file server 503 and therefore rapidly 
accessible to file server 503. 
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Map 603 is an array of map entries 605* There is 
a map entry 605 for each disk block 509 which is part 
of mass storage device 507, and the address of the 
disk block 509 represented by a given map entry 605 
may be calculated from the index of the given map 5 
entry 605 in the array, as is indicated by the arrows 
connecting the first and last map entiles 605 in map 
603 to the first and last disk blocks 509 in mass stor- 
age device 507. 

Moreover, the number of WORM blocks 519 in 10 
WORM device 51 1 is an integ er multiple m of the num- 
ber b of disk blocks 509 and map entries 605. Conse- 
quently, the index (I) of a map entry 605 may be 
computed from a WORM block address (WBA) by the 
operation WBA MOD m, and the disk block 509 rep- 15 
resented by a given map entry 605 may correspond 
to any WORM block 519 for which I = WBA MOD m, 
where I is the index of the given map entry 605. 

Each map entry 605 contains two fields. The first, 
storage element address field 607, contains storage 20 
element address 107 representing WORM block 519 
corresponding to disk block 509 represented by map 
entry 605. In a preferred Implementation, storage ele- 
ment address 107 Is simply a WORM block address. 
The second field, disk block state 609, indicates the 25 
present state of disk block 509 represented by map 
entry 605. There are four states: Not bound: There Is 
no WORM block 519 corresponding to disk block 509; 
Read only: Disk block 509 corresponds to the WORM 
bfock 519 specified by field 607. The WORM block is 30 
a storage element 105 belonging to read only address 
space 117, disk block 509 contains a copy of WORM 
block 519's contents, and disk block 509 belongs to 
read only cache 506. Read/write: Disk block 509 cor- 
responds to the WORM block 519 specified by field 35 
607. The WORM bfock 519 belongs to dump space 
516, disk block 509 is a storage element 105 of prim- 
ary file system 111 which is in read/write address 
space 115, and disk block 509 belongs to read/write 
store 508. Dump: Disk block 509 corresponds to the 40 
WORM block 519 specified by field 607. The WORM 
block 519 belongs to dump space 516, disk block 509 
represents a storage element 105 in read only 
address space 117, and disk block 509 belongs to 
dump store 510. 45 

Implementation 501 operates as follows: when a 
file read operation Is performed, file server 503 uses 
the storage element address 107 of the storage ele- 
ment 105 to be read to locate a map entry 605. That 
address is termed herein address "A". What then hap- so 
pens depends on whether there is a disk block 509 
corresponding to WORM block 51 9 addressed by A in 
mass storage device 507. If there is, field 607 in map 
entry 605 located by address A will contain address 
A. If It does and the map entry 605 is in the read only, ss 
read/write, or dump states, disk block 509 represen- 
ted by map entry 605 contains the desired data and 
file server 503 reads the contents of disck block 509 



If there is not a disk block 509 corresponding to 
WORM block 519 in mass storage device 507 but the 
map entry 605 indicates that the disk block 509 it rep- 
resents has the read only state, file server 503 copies 
the contents of WORM block 519 specified by 
address A into disk block 509 corresponding to map 
entry 605 and writes address A Into field 607. If map 
entry 605 indicates the read/write or dump state, file 
server 503 cannot overwrite the contents of disk block 
509 corresponding to map entry 605 and simply 
fetches the data from WORM block 519. If map entry 
605 indicates the not bound state, finally, file server 
503 fetches the data from WORM block 519, copies 
it into disk block 509 corresponding to map entry 605, 
writes address A into field 607, and sets DBS 609 to 
indicate the read only state. 

When an operation which alters a file is perfor- 
med, file server 503 again uses storage element 
address 107 A to locate a map entry 605. If field 607 
in map entry 605 contains A and indicates the read 
only or dump states, file server 503 takes a storage 
element address 107 B from free list 207 and uses 
address B to locate a second map entry 605. If this 
map entry 605 is in the not bound or read only states, 
file server 503 copies the contents of the disk block 
509 represented by the map entry 605 addressed by 
A to the disk block 509 represented by the map entry 
605 addressed by B, sets field 607 in that map entry 
605 to address B, and field 609 to indicate the 
read/write state. Pointers are updated in the file struc- 
ture as already described and alterations are made to 
the disk block 509 represented by map entry 605 
addressed by B. If the second map entry 605 Is In the 
dump or read/write states, file server 503 takes 
another address from free list 207 and tries again. 

If address A Es different from the address in field 
607, then if map entry 605 indicates the read only 
state, file server 503 copies the WORM block 519 
addressed by A Into the disk block 509 represented by 
entry 605, sets the fields of map entry 605 accord- 
ingly, and proceeds as described above for map 
entries 605 in the read only state. If map entry 605 
Indicates the read/write state or dump state, file ser- 
ver 503 immediately copies the contents of disk block 
509 represented by map entry 605 to the correspond- 
ing WORM block 519, which places disk block 509 in 
the read only state, and then proceeds as just des- 
cribed for map entries 605 indicating the read only 
state. 

When file server 503 deletes a file, It locates map 
e ntry 605 for each disk block 509 which Es a data block 
225 In the file. If there is no entry, or if the map entry 
605 indicates the read only or dump states, the file 
server 503 does nothing; if the map entry 605 indi- 
cates the read/write state, the file server 503 adds the 
storage element address 107 of the corresponding 
WORM block 519 to free list 207 and places the map 
entry 605 for the disk block 509 into the not bound 
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state 

To begin a dump operation, file server 503 goes 
through map 603 and places all map entries 605 
which are in the read, /write state in the dump state. It 
then reestablishes primary file system 111 as prevf- s 
ously described using the fife operations just des- 
cribed. At this point, the dump operation is finished. In 
a preferred embodiment, the operation takes about 10 
seconds. During that time, file system 101 is unavail- 
able for use. While file server 503 continues normal 10 
file operations, a dump daemon process operating in 
fife server 503 writes the contents of all disk blocks 
509 represented by map envies 605 indicating the 
dump state to their corresponding WORM blocks 519. 
When the write of a disk block 509 Is completed, DBS 15 
field 609 is set to indicate the read only state. 

In an alternative embodiment, there may be an 
additional state, "old superblock" for disk blocks 509. 
in such an embodiment when a dump operation 
begins, the disk block 509 containing superblock 203 20 
for primary file system 111 is placed in the "old 
superblock" state until the address of disk block 509 
for the new superblock 203 has been taken from free 
list 207 and copied into superblock 203. At that point, 
disk block 509 containing superblock 203 is placed in 25 
the dump state. 

Conclusion 

The forego! ng Detailed Description has disclosed 
to one of ordinary skill in the arts to which the Invention 
pertains how file system 101 of the invention may be 
implemented. While a preferred embodiment of file 
system 101 is implemented using a magnetic disk 
drive and a WORM optical disk drive, fife system 101 
may be implemented using any devices which provide 
random-access read many-write many storage and 
random-access write once-read many storage. 
Further, devices employing the principles of the 
invention may be implemented using alogorithms for 
file operations and the dump operation which differ 
from those disclosed herein. 



Claims 

1. A file system for use in a computer system, the file 
system being characterized by; 

one or more first- sets of secondary files 
(109); and so 

a second set of primary files (111) whose 
contents include old contents (303, 305, 307) 
which are part of the contents of secondary files 
and new contents (311, 315) which are not part of 
the contents of secondary files. 55 

2. The file system set forth in claim 1 further charac- 
terized in that: 



each set of secondary files conserves the 
state of the set of primary fries at a given past 
time. 

3. The file system set forth in claim 1 or claim 2 
further characterized in that: 

the file system further includes file oper- 
ation means (503) for performing operations on 
the files; and 

the file operation means performs file 
operations on the first sets and the second set 
contemporaneously and in the same fashion, 
except that the file operation means cannot per- 
form file operations on the first sets which alterthe 
files therein. 

4. The file system set forth in claim 1 further charac- 
terized in that: 

the entire contents of the first sets are 
stored in write once/read many storage elements 
(519); and 

the new contents of the second set are 
stored in read/write storage elements (509). 

5. The file system set forth In claim 4 wherein: 

the file system further includes file oper- 
ation means for performing operations on the 
files; and 

the file operations include a dump oper- 



9. The file system set forth in claim 5 further charac- 
terized by: 

the file system further comprises 
a first set (516) of the write once/read 
many storage elements which are unwritten and 
which correspond to the read-write elements 
belonging to the set of primary files and 

the dump operation writes the read-write 
elements belonging to the set of primary files to 



30 ation In which an additional set of files belonging 

to the first sets thereof is created by writing the 
new contents to the wrfte-once/read many stor- 
age elements. 

35 6. The file system set forth in claim 5 wherein: 

the dump operation further reestablishes 
the second set such that alt of the contents of the 
primary files are old contents. 

40 7. The file system set forth in claim 5 wherein: 

the new contents are written to the write 
once/read many storage elements only as a con- 
sequence of the dump operation. 

45 8. The file system set forth in claim 5 further charac- 
terized in that: 

a user of the file system determines the 
time of the dump operation. 
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their corresponding write once/read many ele- 
ments In the first set 

10. A method for altering a file which Is stored in a file 
system having read-write and write once/read 5 
many storage elements for storing file contents, 
the file's contents including new contents, which 
are stored In the read-write elements, and old 
contents which are stored in written ones of the 
write once/read many storage elements, the 10 
method being characterized by: 

when the file is altered by adding new con- 
tents, establishing a correspondence between 
the read-write storage elements containing the 
new contents and unwritten write once/read many 15 
storage elements; 

When the file is altered by removing new 
contents, disestablishing the correspondence be- 
tween the read-write storage elements containing 
the removed new contents and the corresponding 20 
unwritten write once/read many storage ele- 
ments; and 

at intervals, copying the contents of the 
read-write storage elements having correspond- 
ing unwritten write once/read many storage ele- 25 
ments to their corresponding unwritten write 
once/read many storage elements, whereby the 
new contents become old contents. 
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